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We consider a quantum two-level system perturbed by classical noise. The noise is 
implemented as a stationary diffusion process in the off-diagonal matrix elements of 
the Hamiltonian, representing a transverse magnetic field. We determine the invariant 
^5 ■ measure of the system and prove its uniqueness. In the case of Ornstein-Uhlenbeck 

I noise, we determine the speed of convergence to the invariant measure. Finally, we 

determine an approximate one-dimensional diffusion equation for the transition prob- 
'I abilities. The proofs use both spectral-theoretic and probabilistic methods. 
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■ 1 Introduction 

^ : 

OO ' Noise is often used as a model for the effect of the environment (for instance a heat 

■ bath) on a relatively small system. In general, it is difficult to prove rigorously from first 
[ principles that a stochastic model indeed gives a good approximation of the real dynamics. 

QQ ' However, such a proof has been obtained in a number of specific classical systems, see for 

O ■ instance [FKM651 ISLTTl IEPEB991 lEBTOni IRBTn2j . 

^ , For quantum systems, the theory of effective stochastic models is not yet so well- 

'k^ I developed. One approach in which progress has been made in recent years is the approach 

^ ■ of repeated quantum interactions. If the quantum system is assumed to interact during 

. , successive short time intervals with independent copies of a quantum heat reservoir, one 

can under certain assumptions derive effective equations involving quantum noises. See 
for instance |AP06l IBJM061 IAJ07al lAJOTbj for recent works in this direction. 

In the present work, we consider the intermediate situation of a classical noise acting 
on a quantum system. We shall focus on the simplest possible quantum system, namely 
a spin- 1/2. The classical noise is realised by adding off-diagonal stochastic processes in 
the system's Hamiltonian. This situation can be realised, for instance, by letting the spin 
interact with a magnetic field subject to small stochastic fiuctuations, due to the magnet 
creating the field being subject to weak random noise. 

When the spin is prepared, say, in the "down" state, and subjected to a constant 
magnetic field in the z-direction, it will remain in the same state for ever. If the direction 
of the magnetic field is allowed to fiuctuate in time, however, transitions to the "spin-up" 
state become possible. The aim of this work is to estimate how long it takes for these 
transitions to occur, depending on the characteristics of the noise. 



1 



This paper is organised as follows. Section [2] contains a detailed description of the 
model and all results. The main results are the following: Theorem 12.31 shows that under 
rather general assumptions on the noise, the system admits a unique invariant measure 
induced by the Haar measure on SU(2). Theorem 12.61 gives a spectral-gap estimate in 
the case of Ornstein-Uhlenbeck noise, describing the speed of convergence to the invari- 
ant measure, as a function of noise and coupling intensity, and of the rate of decay of 
correlations of the noise term. Finally, Theorem 12.71 uses an effective one-dimensional 
diffusion approximation for the transition probability to derive expected transition times. 
Sections [3l m and [5] contain the proofs of these results. 



2 Model and results 
2.1 Definition of the model 

The simplest possible quantum system is a two-level system (e.g. a spin 1/2), which can 
be described by the unperturbed Hamiltonian 

H.^{l 4) (2.1) 

acting on the Hilbert space W = C^. We would like to perturb this system by "classical 
noise" , able to induce transitions between the two energy levels. The noise should however 
preserve the unitary character of the quantum evolution. A way to do this is to add a 
non-diagonal interaction term to the Hamiltonian, of the form KV{t), with 

nt) = (|^ t) ' Z, = Xt + iYt, (2.2) 

where {Zt}t^o is an ergodic, stationary Markov process on some filtered probability space. 
This is equivalent to assuming that the spin 1/2 is interacting with a magnetic field 
Bt = {2KXt, 2KYt, 1), since the total Hamiltonian can be written 

H{t) = Ho + KV{t) = KXta^ + KYta^ + ]^a^ =: ■ a , (2.3) 

where the cr* are the Pauli matrices. For definiteness, we shall assume that Zt is the 
solution of an Ito stochastic differential equation (SDE) of the form 

dZt = f{Zt) dt + g{Zt) dWt , (2.4) 

where {VFtjj^o denotes a standard Brownian motion, and / and g satisfy the usual Lipshitz 
and bounded- growth conditions ensuring existence of a pathwise unique strong solution for 
any initial condition. A typical choice would be an Ornstein-Uhlenbeck process, defined 
by the SDE 

dZt = -jZtdt + adWt , (2.5) 

where the initial condition Zq is a centred Gaussian of variance a"^ /2'y. This represents 
the situation of the magnet generating the field being subjected to a harmonic potential 
and white noise. This choice is also motivated by the fact that in certain situations, the 
effect of a classical heat bath on a small (classical) system has been rigorously shown to be 
describable by such an Ornstein-Uhlenbeck process |EPRB99] . One can, however, consider 
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other types of stochastic processes as well, and part of our results do not depend on the 
detailed definition of Zt. Furthermore, one can easily deal with more general interaction 
terms than ()2.5p . including several sources of noise for instance. However, the situation 
with a single noise is in some sense the most interesting one, since it is in this situation 
that noise-induced transitions are the most difficult. 

The evolution of the coupled system is governed by the time-dependent Schrodinger 
equation 

idV-t = i/(t)V'tdt. (2.6) 

Provided the stochastic process Zt has continuous sample paths, which are stochastically 
bounded on compact time interval^ (as is the case for the Ornstein-Uhlenbeck process), 
Dyson's theorem implies the existence of a unique two-parameter family of unitary oper- 
ators U{t,s) E U(2), forming a (strongly) continuous semi-group and such that 

i;t = U{t,s)tPs (2.7) 

holds almost surely for all t > s. In our case, H(t) having zero trace, we have in fact 
U{t, s) G SU(2). For fixed s, the process t ^ Ut = U{t, s) satisfies the equation 

idUt = H{t)Utdt . (2.8) 

Thus, characterising the evolution of the quantum system is equivalent to characterising 
the stochastic process {Ut}t^o on SU(2). 



2.2 Coordinates on SU(2) 

In order to study the solutions of Equation (j2.8p , we have to choose a convenient parametri- 
sation of the Lie group SU(2). A possible choice is to decompose elements of SU(2) on a 
basis of identity and Pauli matrices as 

U = i{xia^ + X2cr^ + X3a'') + X4I = { . ■ > (2-9) 

\-X2+lXi X4-IX3J 

where the real and satisfy 

xj + xl + xl + xl = l. (2.10) 
Plugging into (j2.8p and using Ito's formula, one gets the system of equations 

dxi^t = [-\x2,t - K-Xt X4,t - K-Yt X3^t] dt , 
dX2,t = i^Xi^t - KXt X3^t + K-Yt X4,f] dt , 

dxs^t = [-^X4,f + nXt X2,t + i^Yt xi^t] dt , 
dx4,t = [ix3,j + nXt xi^t - KYt X2,t] dt . 



(2.11) 



However, one of these equations is redundant because of Condition (j2.10p . It is preferable 
to work with a three-dimensional parametrisation of SU(2). A classical way to do this 
is to write U G SU(2) as the exponential U = e^'^ , where M lives in the Lie algebra 
6u(2). Decomposing M on the basis of Pauli matrices as M = r{yia^ + y2C'^ + y3C^), with 
-|- y| -|- y| = 1, yields the representation 

^ ^ /cosr-Fiyssinr [iyi + y2]smr\ ,^ 
\[iyi — y2] sin r cos r — i sin r J ' 



Hn other words, limi^oo P{supo<t<y > L} = for all T > 0. 
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One can then write the iji in spherical coordinates in order to obtain a three-dimensional 
system equivalent to ()2.8p . However, the resulting system turns out to have a rather 
complicated form. 

After some trials, one finds that the best suited parametrisation of SU(2) for the 
present situation is given by 

, , /cosxe-'(<^/2+^) sinxe-i(<^/2-V')\ 

The variable y lives in the interval [0,7r/2], while the pair (0/2 + ^,(/>/2 — lives in the 
two-torus T2§ 



Proposition 2.1. The system (j2.8p is equivalent to the system 



dxt = K [Xt sin (j)t + Yt cos </>t] dt , 
2k 
tan 2xt 



2k \ 
^ ^ " ^* ^'"^ j ' (2-14) 



dV't = -^A; — cos - Yt sin (/ijl dt . 
sm 2xt 

Proof: This is a straightforward application of Ito's formula. The second-order term in 
the formula actually vanishes, due to the fact that the diffusion term only enters indirectly, 
via the equation defining Zt, and the change of variables is independent of Z. □ 

Notice that the system (12.14p has a skew-product structure, as the right-hand side 
does not depend on ipf Thus in fact all the important information on the dynamics is 
contained in the first two equations, while the evolution of ^^Jt is simply driven by {xt, 4't) 
without any retroaction. 

In the uncoupled case k = 0, we simply have 4> = 1 while x ip are constant. Taking 
into account the initial condition Uq = 1, we recover the fact that 

/e-'*/2 \ 



2.3 Invariant measure 

We first prove existence and uniqueness of an invariant measure for the process Ut, under 
a rather general assumption on the noise Zt- 

Assumption 2.2. {Zt}t:^o is a stationary, ergodic, real or complex-valued Markov process 
on the (canonical) probability space (17, J^, {J^fjf^O) IP) of the Brownian motion {Wjjt^O; 
defined by the ltd SDE ()2.4p . admitting the unique invariant probability measure v. 

This assumption is satisfied if the drift term / in the SDE (|2.4p is sufficiently confin- 
ing. For instance, in the real case, it is sufficient to assume that —Zf{Z) grows at least 
quadratically as \Z\ oo, and that g{Z) satisfies some ellipticity conditions. 

Recall that the Haar measure of a compact Lie group G is the unique probability 
measure fi on G such that fJ,{gB) = ^{B) for all Borel sets B C G. A computation of the 

^Hence (</>, tp) belong to a twisted two-torus (because u{x, 4> + Stt, ip) — u{x, 05 + ''^))^ but this will be 
of no concern to us. 
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Jacobian of the transformation (|2.13|) shows that in our system of coordinates, the Haar 
measure is given by 

/^(d5) = ^sin(2x) dxdcPdiP . (2.16) 

Theorem 2.3. Assume Assum.ption \2.^ holds. Then for any k ^ the product measure 
V ® II is the unique invariant probability measure of the process {Zf, Ut). 

The proof is given in Section [3j The fact that ® is invariant is checked by a 
straightforward computation, while its uniqueness is proved using a control argument and 
the Stroock-Varadhan theorem. 

Remark 2.4. Introducing a variable p = sin^(x) allows to rewrite the system in such a 
way that the invariant density is uniform. We will use this fact later on in the proof. 

Theorem 12.31 leads to the following observations in terms of the physics of the model. 
Let |±) denote the canonical basis vectors of Ti., i.e., the "spin up" and "spin down" states. 
Assume for instance that the system is prepared in the |— ) state at time 0. Measuring the 
spin at time t, we will get —1/2 with probability 

\{-\Ut\-)f = cos\t = I - Pt (2.17) 

and +1/2 with probability 

\{+\Ut\-)f = sm\t = Pt . (2.18) 

We should beware not to mix two different notions of probability. The expression (j2.17p 
represents the probability of a quantum measurement yielding a certain value, for a given 
realisation a; G of the noise. This is independent of the probability distribution on path 
space of the stochastic process Zt- If the process Ut were in the stationary state p, the 
expected probability of measuring a spin +1/2 would be given by 

l'27v i'2iT /'7r/2 2 

E''[sin2x] sin2x^sin(2x) dxd0dV = - . (2.19) 

Also, we would have for any b 6 [0, 1] 

r^'{\{+\Ut\-)\^<b}= / / -^sin(2x) dxd,/.d^ = 6. (2.20) 

Jo Jo J{x: sin^ x^h} 4vr^ 

However, since by definition Uq = 1, the system cannot be in the stationary state p at 
any given finite time t. At best, it can approach p exponentially fast as time increases — 
to ensure such a behaviour, we have to show the existence of a spectral gap. We shall do 
this under a more restrictive assumption on the noise term. 

2.4 Convergence to the invariant measure 

Assumption 2.5. The process {Zt}t^o is the real-valued stationary Ornstein-Uhlenbeck 
process defined by the SDE ()2.5p . In other words, 

Zt = Zo e-^* +a f e-^(*-^) dW^ , (2.21) 
Jo 

where Zq is a centred, Gaussian random variable, of variance a'^/2j, which is independent 
of the Brownian motion {Wt}t^o- 



5 



Then the invariant measure v is also Gaussian, centred, of variance cr^/27. The pa- 
rameter can be interpreted as the temperature of the heat bath creating the noise, 
while 7 represents the rate of decay of correlations in the bath. 

The assumption that Zt be real is not essential, but it simplifies the notations. In 
effect, we have to study the SDE 

dZt = -7Zt dt + crdTyj , 
dxt = K.Zt sin 4)t dt , 

1 + Ml^") dt , (2.22) 
tan 2xt ) 

kZi cos 4)t , , 

^Wt = dt , 

sm 2xt 

with initial condition (xO)0o) = (0,0). The last equation, for dV't, is not really important 
for the dynamics, and has no measurable effect on physics either, -i/^f having only an 
influence on the phase of matrix elements of Ut- 

With the process Xt = {Zt,xt,4't,'4^t) we associate in the usual way the Markov semi- 
group Tf : ip{-) ^ E[(/9(Xf)|Xo = •]. Its infinitesimal generator is the differential operator 

L L + Z'cf)'^+(l + ^'^^ cos(/>\ d kZ cos</> d ^ 
dx V tan 2% j d(\> sin 2% dil) ' 

where 

is the generator of the Ornstein-Uhlenbeck process. The invariant measure is an 
eigenfunction of the adjoint L* of L, with eigenvalue 0. It is known that Lz has discrete 
spectrum, with real, nonpositive eigenvalues — n7, n E N (the eigenfunctions are Hermite 
polynomials). Since the other variables x and live in a compact set, L also has discrete 
spectrum. Moreover, Theorem 12.31 shows that is a simple eigenvalue of L. 

Theorem 2.6. Assume that Assumption \2.5\ holds. Then for sufficiently small na , there 
exists a constant c, independent of^, k and a, such that all eigenvalues of L except have 
a real part bounded above 6?^ 

c 1 _)_ ^2 2 

- 7^ where T^^^o- = 7 — V - . (2.25) 

T./,na [Kay 7 

The proof is given in Section [H It relies on standard second-order perturbation theory. 

Theorem 12.61 shows that the distribution of the actual process Ut, starting with initial 
condition 1, converges exponentially fast to ^, with rate c/T^^Ka- Thus the expected 
(quantum) probability to measure a value +1/2 for the spin, when it starts in the "down" 
state satisfies 

[sin2 Xt] =\[l- 0(e-^*/^--)] . (2.26) 

Hence for times t ^ 7\,k(7i one can expect that a measurement of the spin will yield —1/2 
or +1/2 with probability 1/2 — provided the result is averaged over many realisations of 
the noise. 

Regarding the dependence of the result on the correlation decay rate 7, we can distin- 
guish two asymptotic regimes: 



For two real numbers a,b, aV b denotes the maximum of a and b and a A 6 denotes the minimum of a 
and b. 
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Figure 1. The probability \{-\Ut\+)\^ = sm^{xt) of measuring a transition from spin 
— 1/2 to +1/2 as a function of time t, for two different realisations of the noise. Parameter 
values are 7 = 1, k = 1 and a — 0.03, so that the relaxation time Tj^^a to the invariant 
measure is of order 2000. 

• For 7^1, the correlations in the Ornstein-Uhlenbeck process decay very slowly, in 
fact Zt resembles a Brownian motion. As a result, the relaxation time T^^^a becomes 
very large. 

• For 7 ^> Ka, the correlations in the Ornstein-Uhlenbeck process decay quickly, so that 
Zt resembles white noise. Then the relaxation time T^^ko- also becomes large. 

Relaxation to equilibrium is fastest when has order 1/(k(t) . 

2.5 Diffusion approximation for the transition probability 

The probability of measuring a "spin up" at time t, if the system is prepared in the "spin 
down" state at time 0, for a given realisation uj of the noise, is given by 

ptiu) = \{-\Ut{u;)\+)\' = sin2(xtM) . (2.27) 

While the spectral gap result Theorem 12.61 vields a control on the average of pt over many 
realisations uj of the noise, it does not describe its time-evolution very precisely. In this 
section we provide a more precise description of the dynamics by giving pathwise estimates 
on pt{uj), in the form of first-passage times. This is done by obtaining an approximately 
closed effective equation for pt, which is the only physically measurable quantity in the 
system. The methods used are partly adapted from those presented in |BG06] . 

Figure [1] shows two sample paths t ^ Pti^), obtained for two different realisations 
Wt{io) of the Brownian motion driving Zf. For the parameter values k = 7 = 1 and 
a = 0.03 used in Figure [H this probability remains larger than 1/2 for all times up to 
1000. Hence the system is still far from its invariant measure. 

Figure [2] shows two sample paths t 1— > pt{uj) in a case with larger noise intensity 
a = 0.1. Now the sample paths have enough time to explore all of phase space, indicating 
that the system has reached equilibrium. Note however that for any given realisation of 
the noise, a spin measurement made after a sufficiently long time may still yield —1/2 
with any probability. Only by making repeated measurements in the course of time would 
one obtain an average probability close to 1/2 — assuming that the measurements do not 
affect the state of the system, which of course they do. 
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Figure 2. The probability \{-\Ut\+)\^ = sm^{xt) of measuring a transition from spin 
— 1/2 to +1/2 as a function of time t, for two different realisations of the noise. Parameter 
values are 7 = 1, k = 1 and a — 0.1, so that the relaxation time T^.^a to the invariant 
measure is of order 200. 



Let us now describe the derivation of the effective equation for pt. Recall that the 
uniform measure is invariant when the system is written in the variables (p, (p, ip). In order 
to exploit symmetries of the problem, it is convenient to use the variable y = 2p — 1 = 
— cos2x S [—1, 1] instead of p. We are led to consider the SDE on R x [—1, 1] x §^ 



dZt = -'jZt dt + a dWt 



dcPt 



2KZt\l 



1 - 2KZf 



sin ( 

yt 



dt 



cos ( 



(2.28) 



yt 



dt 



Observe that if k (or a) is small, then this system displays several distinct timescales. 
While (pt will be close to t, yt can at best grow like Kt. In fact, if Z were constant, one 
can see that the system ()2.28p restricted to (y, p) is conservative, that is, there exists 
a constant of motion K{y,<j)) = y + 0{k). The fact that Zt is time-dependent actually 
destroys this invariance, but in a very soft way. 

The usual way to obtain an effective diffusion equation for y (or for the constant of 
motion K{y, cj))) is to average the right-hand side of (j2.28p over the fast variable (j) |FW04] . 
However, in the present case this average is zero, so that one has to go beyond the usual 
averaging procedure. 

It turns out that one can construct a new variable y = y + k,w{Z, y, (f>) such that 



1 - y2 cos{(Pt + 9) dWt 



(2.29) 



where is a constant phase shift (see Proposition 15.11 for a precise formulation). The 
variance of the noise term grows like t times the square of the coefficient of dWt- Since (pt 
rotates rapidly, we expect that cos'^{pt + G) can be approximated by 1/2. In addition, Z| 
is rapidly fluctuating with average (T^/27. We thus expect that 



dyt 



2(ko-)2 , bUa 



1 + 7 



1 + 7' 



1 - 



y| dWt , 



(2.30) 
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which, after rescahng time by a factor ^o- reduces to 



(2.33) 



dyt ~ -yt dt + ^1 - dM^i . (2.31) 

The sample paths of this system explore phase space in a rescaled time of order 1. 

The approximation (|2.30p is of course not rigorous. But based on the above intuition, 
one can prove the following result on the time needed for yt to explore phase space. 

Theorem 2.7. Assume that Assumption \2.5\ holds. Let 

r(y) =inf{t > 0: > y} (2.32) 

he the random first-passage time of yt at the value y. Then there is a function e{y), 
independent of j, a and k and bounded for y < 1, such that 

(k(t)2 7 

Furthermore, P{r(y) > t} decays exponentially with rate of order l/e{y)T^^K<T- 

The proof is given in Section [5j It uses comparison inequalities for the stochastic 
differential equation satisfied by yt- The main difficulty is that one obtains different 
approximations in different regions of phase space, which have then to be patched together. 
This is done with the help of renewal equations, solved by Laplace transforms. 

The time T^^ko- plays the role of a typical exploration time. It has value 2000 in Figured] 
and 200 in Figure [2j The function e{y) may diverge as y 1. This is due to the fact that 
y = 1 (i.e., X = ■^/2) corresponds to a single curve in SU(2), depending only on (j)/2 — ip, 
a too small set to hit. 

Remark 2.8. 

1. Theorem 12 . 71 does not follow from Theorem 12. 6i For instance, the Ornstein-Uhlenbeck 
process Zt has a spectral gap 7, but the process takes exponentially long times of order 
gi'^/o' to reach values of order h. 

2. Conversely, Theorem 12.61 partially follows from Theorem 12. 71 namely for real eigenval- 
ues. Indeed, given a subset P of phase space, consider the following boundary value 
problem: 

—Lip = Xip for 2; G 2? , 

ip = g iov xe dV . (2.34) 

For Dirichlet boundary conditions y = 0, it is known that the eigenvalue A(P) of 
smallest real part of this problem is real and simple |Jenl21 IPW66j . A classical result 
due to Donsker and Varadhan |DV76| states that 

^(^) > ' (2.35) 

where rx) = inf{t > 0: xt ^ P} is the first-exit time from D. Now if A < X{T>), the 
boundary value problem (12.34[1 has a unique solution for every boundary condition g, 
given by 

^{x)=E-[e^-^g{xrJ] . (2.36) 

Any eigenfunction of L corresponding to a nonzero real eigenvalue must change sign. 
Thus taking V = {x: ip{x) > 0} would yield y = 0, and thus also (p{x) = Vx S P, a 
contradiction. Hence L cannot have any real eigenvalue smaller than X{'D), except 0. 
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T* r * ■ d 

L p = LzP - K.Z sm <p- — 

ox 



^ kZ cos (/) dp 
sin Ix dxjj 



3 Existence and uniqueness of the invariant measure 

3.1 Invariance of the Haar measure 

With the semigroup Tt of the Markov process, we associate the dual semigroup St, acting 
on (7-finite measures p according to 

iStp){B) = J F{Xt GB\Xo = x} p{dx) =: P^jX^ G B} . (3.1) 

Its infinitesimal generator is the adjoint L* of the generator L. If p has density p with 
respect to the Lebesgue measure, then 

/ 2kZ cos c; 
V tan2x 

Now in our case, the measure which is claimed to be invariant is the product measure 
v p, where p has density sin(2x)/47r^. Since is invariant for the process Zt, L*^^ = 0. 
It is then immediate to check that L* p = 0. □ 

3.2 Proof of Theorem [2731 

We would like to show that v ® p \s the unique invariant measure of the process {Zt, Ut). 
Since the generator L of the process is very far from uniformly elliptic, we cannot use 
standard ellipticity (or even hypo-ellipticity) arguments. To circumvent this difficulty, we 
shall combine an argument of control theory with the Stroock-Varadhan support theorem. 
We start by writing the joint system ()2.4p .( |2TT^ as 

dZt = f{Zt) dt + g{Zt) dWt , 

dxt = [boixt) + KXtbi{xt) + K.Ytb2{xt)] dt , (3.3) 

where Zt = Xt + iYt, xt = {xt, (pt, ipt) and 

boix) = (0,1,0) , 

2 cos 6 cos ( 



bi{x) = I sin 



' tan 2x ' sin 2% 



h ^ \ ( A sm0\ 

62X = cos 0,-7 — —,—^]- 3.4) 
V tan2x sm2xy 

We denote by Pt((Zo, xq), -B) = P(^0'^'oH(^t> ^^t) G B} the transition probabilities of the 
Markov process with initial condition {Zq^xq). With (jS.Sp we associate the control system 

Z = f{Z)+g{Z)u{t) , 

X = bo{x) + K,Xbi{x) + KYb2{x) , (3.5) 

where u: M+ — > M is a piecewise constant function. The accessible set from an initial 
condition {Zq,xo) is the set 

At{ZQ,XQ) = {{Z,x): 3n: [0, t] ^ M , (Z(0), x(0)) = (Zq, ^o), (^(t), x(t)) = (Z,x)} . 

(3.6) 

The Stroock-Varadhan support theorem |SV72at ISV72bj states that 



suppP4((Zo,a;o),-) = At{Zo,xo) , (3.7) 
that is, that Pi((Zo, xq), -B) > for any open set B C At{ZQ,xo). 
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Proposition 3.1. For any At 7^ 0, any initial condition (Zq,xq) and any t > 0, the closure 
of the accessible set At{ZQ,xo) is the whole phase space C x [0,7r/2] x T^. 

Proof: We first observe that by Assumption 12.21 tlie process Zt is controllable, that is, 
for any t > and any trajectory {.^sjo^s^t, one can find a piecewise constant control u 
such that f{Zt) + g{Zt)u(t) approximates Z{t) arbitrarily closely. As a consequence, we 
can slightly simplify the problem by considering the three-dimensional control problem 

X = bo{x) + Kbi{x)ui{t) + Kb2{x)u2{t) . (3-8) 

It is in fact sufficient to discuss the particular case G M , that is, U2 = 0, the other cases 
being treated similarly. 

Let r = [0,7r/2] x T^. The accessibility algebra A{x) of a point x S F is the smallest 
sub-algebra of the Lie algebra of vector fields over F containing bo and 61 . It is generated 
by all iterated Lie brackets of 69 and 61 . We identify each vector field bi with an operator 
Ai = ^jb^^dj. Then Lie brackets of bi are identified with commutators of Ai. Now 
straightforward computations show that 

[^0,^1] = ^2 , 
[^0,^2] = -Ai , 

[Ai,A2] = AAo. (3.9) 

As a consequence, the accessibility algebra A{x) is generated by the vector fields bo, bi 
and 62. Since 

det{6o,6i,62} = -^4^ , (3.10) 
sm Zx 

we conclude that span[^(x)] has dimension 3 for any x, except possibly for x S {0, vr/2}. 

In order to treat the case x = '^/'^^ we use the representation (|2.1ip of the system. 
X = 7r/2 corresponds to x^ = X4 = 0. Near a point (x^,X2,0,0), the Lie group SU(2) 
can be parametrised by {y2-,yz-,yi) = {'^2 — 2:2' ^3' ^4)1 ^he remaining variable xi being 
expressed in terms of the other variables with the help of Relation (j2.10p . Writing the 
vector field in variables (2/252/352/4) and computing Lie brackets, we obtain again that the 
accessibility algebra is generated by three vector fields and has dimension 3. The case 
X = is treated similarly. 

Whenever span[^(x)] has full dimension, a standard result from control theory (see 
|NvdS90t Chapter 3]) states that At{x) contains an open, non-empty neighbourhood of x. 
Since this is true for all x, we have proved that A{x) = T for all x G F. □ 

Proof of Theorem 12.31 Let M denote the convex set of all invariant measures of the 
process. With every invariant measure /i € we can associate a stationary Markov 
process P^. It is known that a measure /i G is extremal if and only if the associated 
dynamical system is ergodic. Thus if M. contains two measures /xi 7^ ^12, the measure 
// = ^(/ii+/i2)is invariant but not ergodic. 

The previous proposition implies, with Stroock-Varadhan's support theorem, that 
Pf((Zo, xq), -B) > for any open i? C C x [0,7r/2] x T^. If ^ were not ergodic, we could 
find an open set B, with < ^i{B) < 1, such that Pt{{Zo,Xo), B) = 1 for /i-almost all 
(Zo,xo) G B and Pt{{Zo, xo), B'^) = for /x-almost all {Zq,xo) £ B^, a contradiction. 
Hence /x must be ergodic, and thus M. contains only one measure. □ 
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4 Convergence to the invariant measure 



Let us first remark that since the Ornstein-Uhlenbeck process Zt is proportional to cr, and 
enters in the dynamics only through the coupling constant k, all results will only depend 
on the product kg. We may thus choose one of the parameters at our convenience, keeping 
the product fixed. In this section, we consider that in fact ct = 1, but keep writing a for 
more clarity. 



4.1 Proof of Theorem [2761 

In order to exploit the fact that the invariant measure is uniform when taking variables 
(y = 2sin^x ~ 1)'?^!^')) consider, instead of the infinitesimal generator (j2.23p of our 
diffusion process, the equivalent operator 



d 



L = Lz + kZJx - ip- sin 0— + 



2KZy 
1 , cos ( 



d kZ cos (h d , , , , 

7^ — . (4.1) 



We can write this generator as L = Lq + IkLi, where Lq = Lz + d/d(j). The operator Lz is 
self-adjoint in L^(M , z/(dZ)), and has simple eigenvalues — ^7, n G No- Its eigenfunctions 
are (properly normalised) Hermite polynomials, which we denote hn{Z). In particular, we 
have 



ho{Z) = l, hi{Z) = ^Z. (4.2) 

a 

An integration by parts shows that 

r • 7 R 2 ■ A.^ ^ 2 ^^2/ 9 iZ cos(/) 9 

Li :=-iZVl - r sm07^ + COS0— + —==— (4.3) 

is also self-adjoint in L^([— 1,1] x , dy d(/> d-i/') • We may choose an orthonormal basis of 
L2(M X [-1, 1] X T2, (v ® ^)(dx)) given by 

|n,p,A:,r) = /i„(Z)/p(y)e'^'^e-'/', (4.4) 

where {/p(2/)}pGZ is an arbitrary orthonormal basis of L^([— 1, l],dy) (a Fourier basis will 
do). Since 

Loh,P,^,r) = A°^fc|n,p, A:,r) , A° fc = -n7 + i/c, (4.5) 

we see that Lq has infinitely many eigenvalues on the imaginary axis, which are infinitely 
degenerate. We can nevertheless apply standard time-independent perturbation theory to 
second order in k (see for instance |LL58j ). Expanding eigenfunctions in the basis (14. 4p . 
then expanding everything in k and projecting on the basis functions shows that the 
perturbed eigenfunctions have the form 

\n,p,k,r)+\K 2^ — —j^ \m,q,l,s) +0[k ) , (4.6) 

m,q,l,s ""-'^ "^1' 

where the sum runs over all {m,q,l,s) 7^ {n,p,k,r) such that {m,q,l,s\Li\n,p,k,r) 7^ 0. 
The perturbed eigenvalues have the form 

K,p,k,r = A° + iK(n,p,A;,r|Li|n,p,/c,r) 

-.'Y. + o(.3) . (4.7) 

m,q,l,s '"''^ 
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Note the minus sign due to the fact that the perturbation term i Li is anti-hermitian. We 
now have to compute matrix elements of Li in the chosen basis. We are however only 
interested in matrix elements involving n = 0, which give perturbations of eigenvalues on 
the imaginary axis. Using (j4.2p . we get 



i Zyr^ sm4>^\0,p,k,r) = -^hi{Z) 1 [e'^^+i)-^ - e^C^-^)-^] e^ 



(4.8) 



showing that 



{m,q,l,s\ -iZy/T^^sm(l)—\0,p,k,r) = -j=6.m,iag,p[6i,k+i - Si,k-i\Ss,r , (4.9) 



where 

■ 1 

a, 



f,{yWi-y^fp{y) dy . (4.io) 

Proceeding in a similar way for the other terms of Li, we get 



{m,q,l,s\Li\0,p,k,r) = -^6m,i[{aq,p + bg^p)6i^k+i + {-aq,p + bq^p)6i^k~i]Ss,r , (4.11) 



where 



b,Ak,r) = r U{y)^fiM^Uy) dy . (4.12) 



-1 yr^2- 



The expression (14. lip of the matrix elements shows that the first-order correction to the 
eigenvalues vanishes. It also shows that the second-order correction term in (j4.7p is well- 
defined, because the denominator never vanishes when the matrix element is nonzero. The 
expansion for the eigenvalue becomes 



2 



^Q,p,k,r - IK 2^ 

In particular, 



|ag,p + 6g,p(/c,r)p \aq^p-hq^p{k,r){' 



7+1 7-1 



0{k^) . (4.13) 



Re \o,p,k,r = -^7^^^^ + ^9,p(^> r)? + Wp - Kp{k, r)|2] + 0{k^) . (4.14) 

V 1 ) g 

It remains to see that the sum over q does not vanish. Being a sum of non-negative terms, 
it vanishes if and only if all its terms vanish, which happens if and only if aq^p = and 
bq,p{k,r) = for all q. Now for {k,r) / (0,0), bq^p{k,r) cannot vanish for all q, because 
the function {ky + \r)fp{y) j — cannot be orthogonal to all basis functions. For 
(A:,r) = (0,0), we have 6g^p(0, 0) = 0. However in that case, aq^p = for all q if and only 
if \/l — y^fp{y) is identically zero, that is, only in the case p = where fp{y) is constant. 
But this corresponds to the zero eigenvalue of the invariant measure. □ 
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5 Diffusion approximation 

In this section, it will be more convenient to consider both k and a as small parameters. 



5.1 Averaging 

We consider the SDE on M x [—1, 1] x given by 

dZt = --fZt dt + a dWt , 

dyt = 2KZt sJl-Vt sin (?!)* dt , 

yt 



(5.1) 



d0t 



1 - 2KZt 



: COS (pt 



dt . 



For small k, the variable (pt — t changes much faster than yt, while Zt also fluctuates on 
timescales of order 1 . The philosophy of averaging tells us that the dynamics of yt should be 
close to the one obtained by averaging the right-hand side over all fast variables. However 
this average vanishes in the present case, so that we have to look into the averaging 
procedure in more detail. 

Proposition 5.1. There exists a change of variable y ^ y, with y G [—1, 1], such that 

dyt = F{Zt, yt, <Pt) dt + G{Zt,yt, <t>t) dWt , (5.2) 
where the drift term satisfies 

FiZ,y,^) = -^Z^y + 0^ 



1+7' 



and the diffusion term is of the form 



G{Z,y,4>) = 2Kai 



l-y2 



cosU + e) + o 



(1+^2)2 

K'^aZ 



1 + 7' 



(5.3) 



(5.4) 



V 1 + 7' 
where 6 = arctan7. 

Proof: Averaging amounts to looking for a ^-periodic change of variables removing the 
dependence of dyt on cpf We thus set y = y + kw{Z, y, (p) and plug this into the equation, 
yielding 



dyt = n 



^-yt^^^^t-7Zt— + — 



dt 



+ 2K^Zt 



dw 



1 - sin 04 — 



yt 



dw 



The choice 



w{Z,y,i 



oy a/1 - yf o4>_ 



2Z 



dw 

dt + Kcj— dWt . 
aZ 



■ yl — y^ [cos + 7 sin ( 



1 + 7' 

allows to eliminate the first term in brackets, and yields 



. 4k^7 2 1 

^y* = " i , 2 ^t yt dt + — — 2 

l + Y 1 + 7 



[cos0t + 7sin0t] dWt 



(5.5) 
(5.6) 

(5.7) 



Finally, using the equality cos + 7 sin = -^1 + 7^ cos(0+6') and replacing yt by yt yields 
the above expressions for dyt- □ 

We see that the averaging transformation has created an effective drift term, fluctuating 
rapidly in time. 
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5.2 First-passage times 

We would like to estimate the expected first-passage time of yt at any level y < 1, and for 
the initial condition {yo, (po) = (—1, 0). We split this problem into several parts, estimating 
first the time needed to reach a level —Si < 0, then the level 0, and finally all positive 
y. Also, in order to avoid difficulties due to Zt becoming very large, we will first work 
within the set {lu: \Zt\ ^ 1 Vt}, and deal later with the rare events that \Zt\ becomes 
larger than 1. For this purpose, it is useful to introduce the notation 

Tv = mi{t>0: xt^V} (5.8) 

for the first-exit time of xt = {Zt,yt,(l)t) from a set P C M x [—1, 1] xS^. We denote by 

the law of the process starting in some point xq = (Zo,yO)'/'o) Sit time 0, and by E^" 
expectations with respect to this law. Note that we have to consider here deterministic 
initial conditions Zq, and only at the end will we take expectations with respect to the 
initial distribution of Z. We also introduce the notation 

= 7^ . (5.9) 
[nay 

The following lemma will allow us to reduce the problem to time intervals of fixed size T. 
Lemma 5.2. Fix T > and let 

q{T) = sup P^o{t75 > T} . (5.10) 

Ifq{T) > 0, then 

P^°{t7? >t}^ g(T)-ie-i°S9{T)-it/T 
holds for all t > and all xq £T>. 

Proof: We set t = uT + u, with n = [t/Tj. By the strong Markov property, we have 

P^°{t75 >t} ^P^o{r75 >nr} 

^ E-°[l{,^>(„_i)^}P-("-i)-{r^, > nT}] 
^g(r)P^°{ri,>(n-l)r} 

^ • • • ^ q{TY = e-'*i°g«(^)"' . (5.12) 
The result follows from the fact that n ^ (t/T) — 1. □ 
Note that this estimate implies immediately 

Our general strategy will be to find the smallest possible T such that q{T) is of order 1, 
i.e., independent of the parameters k, a and 7. Then T will give the order of magnitude 
of the first-exit time. 

When deriving these estimates, we will often encounter the process 

Xt = m f Z^, ds-1. (5.14) 
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Lemma 5.3. For any initial condition Zq, we have 

Xt = X^ + Xt, (5.15) 



where X^o has zero expectation, y/X^o + 1 follows a standard gaussian distribution, and 
Xt converges to zero in probability. More precisely, for any e > 0, 

Proof: Write Zt = Z^ + e~'^*(Zo — Z^), where Z^ is a stationary gaussian process of 
variance (T^/27, and substitute in ()5.14p . The hmit Xoo is obtained by applying the 
ergodic theorem to the stationary part. The bound (j5.16p is a consequence of Markov's 
inequaUty apphed to the remaining part. □ 

We start by characterising the time needed to go from —1 to a level —di, where 5i is 
a fixed constant in (0, 1). For an interval / C [—1, 1], we set 

Vj = (-1, 1) X / X S 1 and tj = t-Dj ■ (5.17) 

Proposition 5.4. There exist constants ai, c\ and = 0{b\) such that whenever 

a < (Ti and k < ki, 

P-{rM,-..)>^i(^V^)}^^ (5.18) 

holds for all xq G 

Proof: For t ^ r[_i we have —yt ^ 5i and thus 



F{Zt, yt, <Pt) ^ YT^^' ~ ^^""^ ^ T^^^^t (^-l^) 



1 + 7' 



provided k ^ ni = 0{5i). By the comparison principle for SDEs, we thus have 



yt-yo^^—^t{Xt + l)--—^Yt, 5.20 

1 + 7^ ' 1 + 7 



where we have introduced the martingale 

1 + 7' /■* 



Yt = -— ^ / G{Zs,ysAs)dWs , (5.21) 
2Ka Jq 

whose variance of is bounded above by a constant times t. Now we have, for any T > 0, 



IP"°{r[-i,-50 > T} 5^ F"«{yT < -5i} (5.22) 
^ P-o{Xt < -K}+F-^\Yt ^ ^5iT{l -K) + i±^(5i +yo)| . 
Lemma 15.31 implies that 

P^«{Xt < -K} ^ P^^ol^oo <-K + + P^o|Xt < -tr^j 

= <^(^Vl-K + a^)-'^[-Vl-K + a^)+o(^^^;^^ , (5.23) 
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where ^{x) = (27r) ^^"^ J!^^Q "^/^ du denotes the distribution function of the standard 
normal law. Taking K sufficiently close to 1 (K = 15/16 will do) and and a^T 
sufficiently large allows to make this probability smaller than 1/4. On the other hand, 
taking 5iT larger than 2T*/(1 — K) allows us to bound the second term on the right-hand 
side of Km by P^o{yT > 0} = 1/2. □ 

It follows immediately from Lemma [5.2l that P^°{r[_i > t} decreases exponentially 
fast with rate 7 A ^i/T*, and that 

E-[r[_i,_,,)]=o(iv^). (5.24) 

We now turn to estimating the time needed for yt to reach a neighbourhood of zero. 
More precisely, we shall estimate 

^"'{r{-i+s,,-c*K) >t}= + 62<ys< -c*K, \Z,\ < 1 Vs ^ t} , (5.25) 

where the constant c*, which is related to error terms in (j5.3p . will be defined below. Let 
us start by considering, as a slight simplification of (j5.2p . the linear equation 

l + T 

with initial condition yf} = yo- Let 

Then Ito's formula shows that can be represented as 

yO = e-"(*) + e-W [' e"(^) G(Z„ y„ 0,) dWs . (5.28) 
Jo 

Lemma 5.5. Let tq = inf{t > 0: yf} be the first time reaches 0. Th 



«(0 = -r-TJ I ds = —{Xt + l). (5.27) 



en 



where 



v{t)= rE[e2-WG(Z„y„0,)2] ds. (5.30) 
Jo 

Proof: When yo = 0, the processes and — yf have the same distribution. Thus by the 
strong Markov property, we can apply Andre's reflection principle, yielding, for yg > 0, 

P{to <t} = 2P{yO ^ 0} , (5.31) 

and thus 

p{ro >t} = 2F{y^ > O} - 1 . (5.32) 

Let Yt = /o e"*^*) G{Zs,ys, ips) dWg. Being a stochastic integral, Yj is a Gaussian random 
variable, of expectation 0, while Ito's formula shows that its variance is v{t). Now observe 
that since e"^*^ is a positive random variable, we have 

P{yO > 0} = P{yo + Yt>0}= F{Yt > -yo} 

= ^(^]^- + ^^. (5.33) 
Inserting this in (|5.32p yields the result. □ 
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Before applying this to (|5.2p . we need another technical lemma, allowing to control the 
behaviour of 0j. 

Lemma 5.6. Fix 6 > and an initial condition xq = {ZQ,yQ,(j)Q) £ ^^(-1+5,1-5)- For any 
(p* > (po and K < 6/2, we have 



T^* :=inf{t > 0: </)t = 0*} E 



1 + 2k/S 1-2k/6 



U [r(_i+5,i_5),oo] . (5.34) 



Proof: Either r^* ^ ^-1+5,1-5) and we are done, or r^* < ^-i+s^is)- the latter 
case, (|5.1|) implies that [1 — 2n/5]dt ^ d(j)t ^ [1 + 2K/6]dt, and the result follows by 
integrating from to r^* . □ 

Proposition 5.7. There exist constants c* , C2 and K2 = 0(^2) such that whenever k < K2, 



■T{-i+52~c*k) >t \ ^^^j|=iexp|-|^ \ (5.35) 



holds for all xq G I'(_i+52,-c*k) ^'^^ i ^ . 

Proof: For t ^ r(_i+52,i-<52)' ^® have \Zt\ < 1 and thus 

F{Zt,yt,(t>t)^-^^Z^[y + c'K] (5.36) 

for some c* > 0. By the comparison principle for SDEs, it follows that yt + c*k ^ y^, 
where obeys the SDE (fOGj) . We can thus apply Lemma [5.5l and the proof amounts to 
finding an exponentially growing lower bound for the variance v{t) defined in (j5.30p . 
Since for t ^ r(_i_(_52 we have 1 — ^ 262 — (51 ^ 62, if follows that 

G{Zt,yt, <Ptf ^ ^ cos2(,/.t + Q) (5.37) 
for these times. We can thus write, using Jensen's inequality, 

^^(^) = S- rE[e'°('^G(Z„y„<A.)2] ds 

402 4()2 Jo 

-^W^ l{cos2(</,.+e)^i/2}E[e'"^'^] 

^1 /"* 1 2Era(s)l 1 

^ 2 / l{cos2(</.,+e)^l/2} e L ds 

1 /■* 

^ o / l{cos2(<A,+0)>i/2| e^"''^* ds . (5.38) 
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Lemma [5.61 implies that (taking k ^ (^2/4) during any time interval of length 7r/(l — 2k/(52), 
cos^((/)s + 6*) stays larger than 1/2 for a time span of length 7r/2(l + 2^/82) at least. This 
implies that 

/.(fc+l)7r/(l-2K/52) T* 

Jfc7r/(l-2K/<52) ^ 



" 2(1 + 2k/ 62) ^ ' 

This allows the variance v{t) to be bounded below by a geometric series, whose sum is of 
order ^2(6^*''"^* ~1)- The result thus follows from Lemma 15.51 □ 
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Finally, we consider the problem of yt reaching any level in (—1,1). 

Proposition 5.8. For any 5^ > 0, there exist constants C3, h and = 0{5^) such that 
whenever k < k-^, 

F»{r<-«..-«>|(ivr*)}<*(lz|) (540, 

holds for all xq G 'D(^_ij^^^^i_^.^y 

Proof: As in the proof of Proposition 15.71 we can bound yt below by — k, where y^ is 
the solution of the linear equation (j5.26p . Now for any T, L > 0, we can write 



P'^o/ sup y? < l| < P^o| inf 



a(t) 2 
<t<T t T* 



+ P-o I sup < L, 3t G [r/2, T]: a{t) < ^\ . (5.41) 



Using the process Xt introduced in (j5.14p . the first term on the right-hand side can be 
rewritten as 

P^o| inf Xt^ol, (5.42) 
{T/2^t<iT J 

which decreases exponentially fast, like e"'''^. Choosing 7T ^ 0(1/^3) makes this term of 
order e~^/^'^. Let again Yt denote the stochastic integral e"^*) G(Zs, y^) 0s) dW^- The 
second term on the right-hand side of (j5.4ip can be bounded by 

/ sup e-(*) (yo + Yt) < L, 3t e [r/2, T] : a{t) < ^ 



^ sup ^(^^^^^), (5.43) 

telT/2,T] \ \/v{t) J 

where v{t) can be estimated with the help of (j5.38p . Taking T sufficiently large that 
g-2T/T* ^ ^^12 allows to bound v{T/2) below by (^3/2) e^'^/'^*. The argument of <I> can 
thus be bounded by a constant times l/y^, while L = 1 — 63. This yields the result. □ 

A partially matching lower bound is given by the following estimate. 

Proposition 5.9. There exists a constant C4 such that for any L G (0, 1) and any initial 
condition xq = (Zo,yoi'Ao) with yo > —L, 

P^«|^^nf^^yt < -l| ^exp{-C4[L + yo-c*K]^} . (5.44) 

Proof: Using the same notations as in the previous proof, and the fact that a{t) ^ 0, 
we can bound the probability by 



\ sup i-Yt) >L + yo-c*K} . (5.45) 



Since Yj is a martingale, a standard argument based on Doob's submartingale inequality 
applied to e^^* (cf. [BG031 Lemma 3.3]) allows to bound this probability by the exponential 
of —Ci{L + yQ — c*K)'^/v{T*). The variance v{T*) can be bounded above by a constant. □ 
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5.3 Renewal equations 

We now have to patch together the different estimates obtained in the previous section 
in order to bound the expected transition time between general domains in phase space. 
We shall do this by using renewal equations, that we will solve using Laplace transforms. 
Recall that the Laplace transform of a random variable r taking values in M _|_ is given by 

/•oo o poo 

E [e^^] = / e^* — P{t ^ t} dt = 1 + A / e^* P{r > t} dt , (5.46) 
Jo ot Jq 

provided A is such that lim^^oo e'*** P{t > t} = 0. If r takes values in U {oo}, we can 
also define 

poo 

IE [e^^ l{r<oo}] = P{t < oo} + A / e^* F{t < t < oo} dt , (5.47) 

Jo 

provided A is such that limt^oo e'*'* F{t < r < oo} = 0. 

It is instructive to consider first the case of a one-dimensional process {yt}t:^Oi solution 
to a one-dimensional autonomous stochastic differential equation. We assume that yt £ 
[—1,1] for all t, and introduce levels — 1 < /ii < /12 < /13 < 1 (Figure [3^). We set 
Vi = [—1, /12], = [hi, h^] and introduce first-exit times ri = tx>j, T2 = rpj, r = rx)^ux>2 
and 

T-^=mi{t>0:yt<hi}. (5.48) 

The following result allows to express the expectation of r using informations on ri, T2 
and T\_. 

Proposition 5.10. Assume there exists an e > such that the Laplace transforms 
E/ii^gArij E'^ajeAra] fl^^^^ j^^, x^^_ Then 

, , , E^i \ti \ + E^^ \t2\ 

Proof: Since r > ri for all initial conditions in T>i, we have, by the strong Markov 
property and time homogeneity, the renewal equation 



^^^{t > t} =P'^i{ri > t} +E'^i [l{^^^t}P'^2,n|^ > 



'^'{ri >t}+ r^P^i{Ti 5^ s}F^''{t >t-s} ds 
Jo c's 



(5.50) 



Taking the Laplace transform of (j5.50p and making the change of variables t — s = u shows 
that 



poo o poo 

E'^ife^n = E'^ne^^M + A / e^^ ^P'^Hn ^ s} ds / e^^P'^^ > ^ 

Jo Jq 
= E^i [e^^i] + [e^^i] (E^2 [gAr^ _ 

= E^i[e^^i]E''2[gAr] _ ^5^5-^^ 

Now since for initial conditions in 1)2, ^2 = t ^ filso have the renewal equation 

P'^^l^ > t}=F''2{r2 > t} +E'^2[l{,^^t^,,|P'^i'-N{r > t}] . (5.52) 
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Figure 3. (a) The setting of Proposition [STTOl The first-exit time T2 from I?2 being the 
minimum r^^ A r, the distribution of t can be related to the distributions of ti, T2 and t-^. 
(b) The setting of Proposition [5TT21 



The condition T\_ ^ t A r2 can be rewritten as ^ t, where G M_|_ U {co} denotes the 
first time the process yt-, killed upon reaching /i3, reaches hi (we set r-^ = 00 in case this 
never happens). Taking the Laplace transform, we get 

Combining (I5.5ip with (I5.53p . we obtain 

E''i[e^-i](E^2[e^-2]-E'^^[eKl # ]) 

E^i [e^^] = ^ ^ ^ . (5.54) 

l_E'^i[e^n]E'^2 [e^^N 1^^^^^^] 

The result then follows by taking the derivative of this relation with respect to A, evaluating 
it in A = 0, and using the fact that P'^^j^* < 00} = P^^j^^ <T2]. □ 

Remark 5.11. Relation (|5.54p shows that we do in fact control the Laplace transform, 
and thus the distribution of r. Since 

P{r >t]= P{e^^ > e^*} ^ e-^*E[e^^] (5.55) 

for all A such that E[e'^'^] is bounded, we see that the tails of the distribution of r decay 
exponentially fast, with a rate controlled by the domain of the Laplace transform. This 
domain depends on the rate of exponential decay of ri and T2 and on the denominator 
in (f534]l . 

Relation (15.49P has a slightly asymmetric form, due to the fact that in the situation 
considered, we always have ti < r. It can however easily be extended to situations where 
this relation does not hold. We will consider the still more general situation of a time- 
homogeneous SDE in M". Let Pi and V2 be two open sets in M", and let ri, T2 and r 
denote the first-exit times from T>i , T>2 and Pi U P2 respectively. Finally let Ci = dDi n P2 
and C2 = dV2 n Pi (Figure Eb). 
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Proposition 5.12. Assume there exists an e > such that the Laplace transforms of ti 
and T2 are finite for all \ < e. Then 

2( sup E^[ri] + sup E?^[r2] ) 

sup E=^° \t\ < "^^^ ^^^^ ^ (5 56) 

xoev^uV2 ^ ^ ^ 1 - sup F'^lxr, G Ci} sup Fy{xr^ G C2} ■ 

XGC2 y&Ci 

Proof: Let rf" denote the first-exit time from Vi of the process killed upon hitting 
dVi \ T)2, i.e., we set tJ^ = 00 in case xt hits dVi \ P2 before Ci. Then we have, for initial 
conditions x S Pi, 

P^{r >t}= P^'ln > t} +E^'[l^^#^^jP^'-f{T > t - T*}] . (5.57) 
Taking the Laplace transform, and using the change of variables t = + s, we get 

E^ [e^"] = E^' [e^"i] + A / e^" E^ l^^#^^jP^'-i* [r > s}] ds . (5.58) 



Evaluating the derivative in A = yields the bound 

E^[r] ^ E^[ri] + sup E2^[r]P^{rf < 00} . (5.59) 

yeCi 

A similar relation holds for initial conditions y ^ T>2. Combining both relations after 
taking the supremum over x G C2 and y G Ci, we get 

sup W\ti] + supE2'[r2] sup P^jrf < 00} 

supE"" r ^ ^ — , (5.60) 

xeCa 1 - sup P^jrf < 00} sup P^{ 

X&C2 yeCi 

and a similar relation for initial conditions in Ci. Using again (j5.59p and its equivalent, 
but now for general xq £ T>i and yo G 1^2, yields the result (after some simplifications - 
the upper bound is not sharp). □ 

5.4 Proof of Theorem [27fl 

We can now proceed to the proof of Theorem 12. 7^ characterising the expectation of the 
first-passage time 

T{y)=mf{t>0:yt>y} (5.61) 
of yt at any level y G [—1, 1]. Notice that we have (cf. (j5.17p ) 

r[-i,y) = T{y) A rz , (5.62) 

where 

Tz = inf{t > 0: > 1} (5.63) 
is typically very large for small a. We start by bounding the expectation of T[_i ,^). 
Proposition 5.13. For any xq = (Zo,yO)</'o) with \Zq\ ^ 1, 

1 



where the function ei{y) is bounded for y < 1. 



V 
7 



(5.64) 
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Proof: We start by setting Vi = and I?2 = T^{-i+52-c*k)- Then Proposi- 

tion 15.121 yields a bound of the form 



2{Ei + E2 

where Proposition 15.41 shows 



(5.65) 



^1 = sup E^' [r[_i,_5^)] = O ( 1 V ^ ) , (5.66) 



7 ^1 



and Proposition 15.71 yields 



E2 = sup [t(_i+5,,_,*,)] ^ . (5.67) 

We expect Pi to be very close to 1, so we only try to bound P2, which is done as follows. 
Let and denote the first-hitting times of the levels —1 + 82 and —c^k respectively. 
Then 

P2= sup P"{y.[_i,_,^) = -1 + ^2} 
= sup F-{t^<t^} 

x: y=-Si 



^ sup 

x: y=-5i 



^■{r^ < T"} + P^{t/ > T*} . (5.68) 



Proposition 15.91 shows that P'^Its^ < T*} is of order e~'^4(i-52-2c*K)2^ while Proposition 15.71 
shows that F^{t^ > T*} is of order |(5i|/\/52. Thus choosing, for instance, 62 = 1/2, and 
61 small enough makes P2 bounded away from one. This proves (j5.64p for all y < —c*k. 
We now repeat the procedure, going first up to level 1/2, and finally to level 1 — ^3. The 
5iS can be chosen each time in such a way that P{t\^ < t^} is bounded away from 1. □ 

Proof of Theorem 12.71 We wiU use the fact that the Ornstein-Uhlenbeck process Zt 
reaches in a time of order I/7, and needs an exponentially long time to go from to 1. 
In order to apply Proposition 15.12] we introduce sets 

Pi = (-l,l)x[-l,y)xSi=P[_i,^) 

P2 = M* X (-l,y) X §1 . (5.69) 

Then the first-exit time from 2?2 equals tq Ar(y), where tq denotes the first time Zt hits 0. 
We have Ci = 9Pinp2 = {-1,1} x (-l,y) xS^ and C2 = dV2nVi = {0} x (-l,y) xS^. 
Thus mUmti yields 

sup IE"[t[_i,j,)] + sup Ey[To] sup P"{rz ^ r(y)} 

sup E- \T{y)] ^ , — ^ . (5.70) 

xj, ^ ^^^^ 1 - sup F-{tz ^ T(y)} sup Fy{ro ^ riy)} ^ ' 

X&C2 yeCi 

Using the reflection principle, one obtains E^[ro] = 0(1/7). Furthermore, we can write 
for any K > 

^""{tz ^ T{y)} ^ P"{tz < i^} + P"{t(2/) Atz>K} . (5.71) 
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We choose K = iV(7"i V T*) for some > 0. Then on one hand, Markov's inequal- 
ity, (j5.62p and Pr op osition 1 5 . 1 3 1 yield 

F-{r(y) ^rz>K]= P^{r[_i,,) > K] ^ ^ £lM . (5.72) 

On the other hand, a well-known property of the Ornstein-Uhlenbeck process is that 
^ behaves like (ET/cr) e""^/*^ (see, for instance, |BG021 Proposition 3.3] or 
|BG041 Appendix]). Thus choosing for instance A^^ = ei(y)(Te'^/'^^ /(7~^ V T*) makes 
^^{tz ^ Tin)} of order \/ei{y){'J^^ V T*)a~^^'^ e'^^'^'^ , which is negligible compared to 
the expectation of T[-i,y) and to 1. This proves the result for initial conditions x G €2- 

In order to extend it to general initial conditions, it suffices to apply (j5.59p and its 
twin relation, and to integrate over the initial distribution of Z. □ 
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